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Abstract 

Background: WInile e-learning is enjoying increasing popularity as adjunct in modern teaching, studies on this topic 
should shift from mere evaluation of students' satisfaction towards assessing its benefits on enhancement of 
knowledge and skills. This pilot study aimed to detect the teaching effects of a blended learning program on students 
of orthopedics and traumatology in the context of a problem-based learning environment. 

Methods: The project NESTOR (network for students in traumatology and orthopedics) was offered to students in 
a problem-based learning course. Participants completed written tests before and directly after the course, 
followed by a final written test and an objective structured clinical examination (OSCE) as well as an evaluation 
questionnaire at the end of the semester. Results were compared within the group of NESTOR users and 
non-users and between these two groups. 

Results: Participants (n = 53) rated their experiences very positively. An enhancement in knowledge was found 
directly after the course and at the final written test for both groups (p < 0.001). NESTOR users scored higher than 
non-users in the post-tests, while the OSCE revealed no differences between the groups. 

Conclusions: This pilot study showed a positive effect of the blended learning approach on knowledge enhancement 
and satisfaction of participating students. However, it will be an aim for the future to further explore the chances of this 
approach and internet-based technologies for possibilities to improve also practical examination skills. 

Keywords: E-learning, Orthopedics, Traumatology, Problem-based learning. Blended learning 



(bmc 

Medical Education 



Background 

In recent years, there has been a growing interest in re- 
search on the education and learning progress of stu- 
dents in medicine. Great effort has been put into 
knowledge transfer via internet-based electronic learn- 
ing (e-learning) [1]. 

E-learning has also become an integral part of medical 
education [2-10]. Various authors have shown that great- 
est benefit and student satisfaction is achieved when com- 
bining e-learning with face-to-face courses, as blended 
learning [2-4]. Blended learning comprises the systematic 
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integration of online and face-to-face engagement to sup- 
port and enhance a meaningful interaction between stu- 
dents, teachers and resources [11,12]. When attempting to 
successfully facilitate the transfer of knowledge, it is essen- 
tial that teaching be competent, appealing, and recipient 
oriented [5]. In this context, e-learning can be achieved e.g. 
by providing videos [6], podcasts [7] or interactive diagnos- 
tic tools [8], leading to a considerable improvement of 
knowledge transfer capabilities in a mix with face-to-face 
lessons [9,10]. However, more studies are still needed to 
proof the impact of e-learning and blended learning on the 
enhancement of students' knowledge and clinical skills in 
general and in the field of orthopedics and traumatology 
particularly. 

After the launch of e-learning courses in recent years, 
many studies have focused primarily on evaluating stu- 
dents' satisfaction - an important factor in acceptance and 
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use of e-learning [13-15]. Others have additionally ana- 
lyzed e-learning's influence on the acquisition of know- 
ledge or skills [3,6,8,9,12,16]. 

In traumatology and orthopedics education such studies 
are comparatively still rare [13,17,18], despite the fact that 
e-learning might substantially improve quality and success 
of teaching in these highly clinically and practically ori- 
ented disciplines. While the number of musculoskeletal 
diseases and injuries has been steadily increasing over the 
last years [19], data indicate that medical student educa- 
tion concerning the diagnosis and treatment of musculo- 
skeletal diseases should be enhanced [20]. Here, e-learning 
could add appeal [21] and promote better knowledge and 
clinical skills [18] by providing useful multimedia adjuncts 
(e.g. videos, podcasts, or radiological cases). However, 
more data is still needed to guide the design of blended 
learning curricula in these subjects, questioning especially 
to what extend the use of e-learning might be beneficial 
and to investigate the effect of different approaches or 
configurations of e-learning. 

To further address these issues, we performed a pilot 
study in the teaching of students in orthopedics and trau- 
matology. The chosen curriculum focused on strengthening 
interdisciplinary knowledge and heavily utilized problem 
based learning (PBL) with a student-centered teaching ap- 
proach, encouraging problem-oriented, self-directed and 
self-organized learning. To evaluate different aspects of in- 
corporating a supplementary e-learning component, follow- 
ing questions were asked in this study: 

1. Will students appreciate an additional e-learning 
offer in a blended learning context? 

2. Will user of the e-learning offer show a superior 
improvement in theoretical knowledge compared to 
non- users? 

3. Will users perform better in clinical examination 
skills compared to non-users? 

The findings should allow a more informed discussion 
about the aspects that may have to be considered when 
integrating blended learning approaches into a PBL cur- 
riculum of orthopedics and traumatology. 

Methods 

Setting 

All students taking part in the pilot study were in their 
fifth year of medical studies in winter semester 2009/ 
2010. In their curriculum, for the first five of sbc years 
(two semesters per year) teaching was organized into 
block courses, covering different topics along a longitu- 
dinal learning helix. Following basic orthopedic concepts 
in the first semester, a two week block course, "Upper Ex- 
tremities and Spine", was specifically dedicated to increase 
knowledge of traumatologic and orthopedic diseases and 



furthering clinical skills in the ninth semester. Participation 
in the latter course was mandatory for all students and this 
course was chosen to incorporate a new e-learning module 
called NESTOR (network for students in traumatology 
and orthopedics), provided through the learning man- 
agement system (LMS) Blackboard (Blackboard Inc., 
Washington D.C., USA) with multiple features: 

- Orthopedic examination videos (covering inspection, 
palpation, motion and special tests) (Figure 1). 

- Interactive radiology cases with X-rays, MRI- or 
CT-images and a patient history. After being asked 
to generate and enter a hypothesis for the diagnosis, 
the correct answer was given along with explanations 
for the ensuing treatment. 

- Audiovisual podcasts for common traumatologic or 
orthopedic diseases (with medical history, 
diagnostics, therapy, and prognosis). 

- Multiple-choice questions were available all the time 
to enable the students to self-test their gain in 
knowledge. 

Design of the study 

Prior to the beginning of the course, students were in- 
formed where to find and how to access NESTOR on the 
LMS Blackboard and about its contents. Clinical tutors 
were provided with similar information. All students of 
the semester who were as well participants in the course 
were asked to take part in the study. The option of enrol- 
ling in NESTOR was voluntary. AH participants had con- 
tinuous access to NESTOR during the whole semester. The 
e-learning module contained no information not otherwise 
taught (e.g. in classes or regular study books). A tracking 
function to detect the individual accessed e-learning tools 
or the time students spend with them was not included in 
this pilot study. 

All students were asked to complete a 20-item multiple- 
choice test before (pre-test), directly after the block course 
(post-test 1), and then three months later at the end of the 
semester (post-test 2). For every item one correct and four 
wrong answers were given. Tests were created by four in- 
dependent clinical specialists without knowledge about 
the content of NESTOR. All tests were anonymized using 
code names. Students were asked to tick a box if they had 
used NESTOR for learning and preparation during the se- 
mester. Those who did were regarded as "user", those who 
did not as "non-user". At the end of semester students had 
to pass a mandatory objective structured clinical examin- 
ation (OSCE) with taking patients history, performing a 
physical examination and diagnosing actor-patients. The 
results of the OSCE were taken as evaluation of practical 
examination skills. Additionally, students' opinion about 
the course was evaluated anonymously. As in the written 
tests (see above) students were asked to tick a box, if they 
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Figure 1 Examination video. Legend: Example of an examination situation of the shoulder (here: Special tests - Apprehension-Test) as shown 
in the videos on NESTOR. 



had used NESTOR during the semester and to continue 
with different questionnaires for NESTOR users and non- 
users (5-points Likert scale or self-response short answers): 

1. Users were asked for (1) their use of NESTOR during 
the study and also their prior use of the LMS 
Blackboard to get an idea of the experiences with 
electronic media and e-learning in general, (2) effi- 
ciency of use and structure of NESTOR, (3) satisfaction 
with its contents and technique, (4) general informa- 
tion concerning the course, and (5) personal informa- 
tion (20 items - 17 Likert scale, 3 short answers). 

2. Non-users were asked for (1) their use of the LMS 
Blackboard, (2) general information concerning the 
course, (3) reasons for not having used NESTOR 
and general acceptance of e-learning, (4) personal 
information (14 items - 12 Likert scale, 2 short 
answers). 

Results of Likert-scaled questions were tabulated and 
free text answers were reviewed for recurring topics by 
two reviewers independently. 

Written informed consent was obtained from all par- 
ticipants including the allowance to use test and evalu- 
ation results as anonymous data for the study (regarding 
students) and to use a picture of the video for publica- 
tion (regarding the "actors" of the video, both medical 
doctors). Additionally, permission was obtained from the 
responsible educational Ethikkommission der Charite - 
Universitatsmedizin Berlin. 



Statistical analysis 

Written tests were validated by calculating Cronbach's 
Alpha. Data of the written tests were analyzed for changes 
between pre- and post-tests as well as post-test 1 and 2 
within the groups of users and non-users using unpaired 
student's t-test. To detect differences in the evaluation be- 
tween NESTOR users and non-users a chi-square test was 
performed for each question. A p-value less than 0.05 was 
considered to indicate a significant (< 0.01: highly signifi- 
cant) difference between the observations and the expecta- 
tions based on the null-hypothesis. Statistical analysis was 
performed with SPSS" 17.0 statistics software (SPSS Inc., 
Chicago, IL, USA) and GraphPad Prism*5 (GraphPad Soft- 
ware Inc., San Diego, Ca, USA). 



Results 

A flowchart illustrating the flow of the study, the num- 
ber of participants (in each group) and the drop-outs is 
shown in Figure 2. Altogether, 53 students were enrolled 
in the PBL curriculum and thus the above mentioned 
course in winter semester 2009/ 2010. Of these, 52 stu- 
dents (98%) took part in the evaluation (35 NESTOR users 
(10 male (29%) and 25 female (71%), 17 non-users (7 male 
(41%) and 10 female (59%)). 44 students (83%) voluntarily 
participated in the written tests (29 (66%) users, 15 (34%) 
non-users). All students took part in the OSCE (35 (66%) 
users, 18 (34%) non-users). Varying participation numbers 
were due to absence on test-days or single refusals to 
participate. 
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n = 53 



blocl< course 

"Upper Extremities and Spine" 
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n = 44 
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post-test 1 

n = 44 
(29 users, 1 5 non-users) 



end of semester 

n = 53 
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post-test 2 

n = 44 
(29 users, 15 non-users) 



OSCE 

n = 53 
(35 users, 18 non-users) 



evaluation 

n =52 
(35 users, 17 non-users) 



Figure 2 Flowchart with study design and number of participants. Legend: Detailed presentation wlien tests, OSCE and evaluation were 
performed during the semester and how many students participated (n). The number of NESTOR users and non-users are shown in brackets. 



Feedback from evaluation questionnaires 

Evaluation of the questionnaires (Tables 1 and 2) showed 
no significant difference between the two groups with re- 
spect to employment status (12 non-users (70%) and 23 
users (66%) reported having jobs in addition to studying). 

Students who used NESTOR were very satisfied with its 
offering (92%), approved its overall structure (83%), and 
had fun learning with it (91%). The blended learning con- 
cept was very positively accepted (97%) and NESTOR was 
considered to be helpful in preparing for clinical situations 
(74.3%). This very positive evaluation went along with a 
strong support by the students for continuing the use of 
this approach (91%). However, non-users also had positive 
attitudes towards e-learning in general (71%), and were in 



favor of e-learning being offered as a supplement to face- 
to-face teaching (77%). 

A significant difference was seen in the correlation be- 
tween the use of NESTOR and pre-existing use of the LMS 
Blackboard. 91% of NESTOR users were already using 
Blackboard, compared to 59% of non-users (p < 0.01). 

When asked what they liked most about NESTOR, stu- 
dents rated videos first, followed by (in decreasing order) 
interactive x-ray cases, online-layout and extent of the of- 
fered material, and finally availability of podcasts and tests. 
Users also rated positively that online-contacts were reli- 
able and that their questions were answered prompdy. As 
improvements, students especially suggested more radio- 
graphic cases, with single remarks for more theoretical 



Table 1 Results of Likert-scaled evaluation questionnaires filled in by 35 (100%) users (with absolute students' numbers) 





Abstain 


Strongly 
disagree 


Disagree 


Neither agree 
nor disagree 


Agree 


Strongly 
agree 


The following Likert-scaled 
questions/statements were asked... 


% (n) 


% (n) 


% (n) 


% (n) 


% (n) 


% (n) 


...e-learning provides a more flexible learning experience 


0(0) 


0 (0) 


2.9 (1) 


5.7 (2) 


37.1 (13) 


543 (19) 


... Managing my free time is a clear advantage of 
e-learning compared to only face-to-face teaching 


0(0) 


2.9(1) 


5.7 (2) 


20.0 (7) 


37.1 (13) 


34.3 (12) 


...1 estimate my learning success to be high 


14.3 (5) 


0 (0) 


2.9 (1) 


40.0 (14) 


42.9 (15) 


0(0) 


...1 was very satisfied with the learning resources on NESTOR 


0(0) 


0 (0) 


0(0) 


8.6 (3) 


68.6 (24) 


22.9 (8) 


...1 estimate an online-support (e.g. via Email) 
would be very helpful and desirable 


2.9 (1) 


2.9(1) 


2.9 (1) 


22.9 (8) 


37.1 (13) 


314 (11) 


...NESTOR is easy to use and well structured 


0(0) 


0 (0) 


2.9 (1) 


14.3 (5) 


57.1 (20) 


25.7 (9) 


...1 appreciate the blended learning concept 


0(0) 


0 (0) 


0(0) 


2.9(1) 


42.9 (15) 


54.3 (19) 


...learning with NESTOR was fun 


0(0) 


0 (0) 


2.9(1) 


5.7 (2) 


514 (18) 


40.0 (14) 


...NESTOR better prepared me to face clinical problems 


0(0) 


0 (0) 


2.9(1) 


22.9 (8) 


54.3 (19) 


20.0 (7) 


...NESTOR should continue to be used in future offerings of this course 


0(0) 


0 (0) 


0(0) 


8.6 (3) 


314(11) 


60.0 (21) 


...The learning texts were easy to comprehend 


0(0) 


0 (0) 


0(0) 


2.9(1) 


57.1 (20) 


40.0 (14) 


...Pictures and videos used promoted learning of the materia 


0(0) 

Abstain % (n) 


0 (0) 
Yes % (n) 


0(0) 
No % (n) 


2.9(1) 


374 (13) 


60.0 (21) 


...Do you use e-learning offerings on the LMS Blackboard in general? 


0(0) 


914 (32) 


8.6 (3) 








... Do you have a job in addition to studying? 


0(0) 


65.7 (23) 


34.3 (12) 
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Table 2 Results of LIkert-scaled evaluation questionnaires completed by 17 (100%) non-users 
(with absolute students' numbers) 



Th6 followinQ Lik6rt-sc3l6d c|u6stions/st3t6m6nts wgtg 3sk6d... 


Abstain 


Strongly 


Disagree 


Neither agree 


Agree 


Strongly 






disagree 




nor disagree 




agree 




% (n) 


% (n) 


% (n) 


% (n) 


% (n) 


% (n) 


... 1 estimate my learning success to be liigh 


0 (0) 


0 (0) 


5.9 (1) 


58.8 (10) 


35.3 (6) 


0 (0) 


... tlie course better prepared me for facing clinical problems 


0 (0) 


0 (0) 


0 (0) 


294 (5) 


70.6 (12) 


0 (0) 


...e-learning in general is useful 


1 1 .8 (2) 


0(0) 


0(0) 


177 (3) 


294 (5) 


41.2 (7) 


...e-learning should be offered as a supplement to face-to-face teaching 


5.9(1) 


0(0) 


0(0) 


177 (3) 


35.3 (6) 


41.2 (7) 


...1 have the technical requirements to use e-learning 


5.9(1) 


0(0) 


0(0) 


1 1 .8 (2) 


5.9(1) 


76.5 (13) 


... e-learning gives me a more flexible learning experience 


5.9(1) 


0(0) 


5.9 (1) 


23.5 (4) 


35.3 (6) 


23.5 (4) 


... Managing my free time is a clear advantage of 


5.9(1) 


0 (0) 


0(0) 


23.5 (4) 


41.2 (7) 


294 (5) 


e-learning compared to only face-to-face teaching 
















Abstain % (n) 


Yes % (n) 


No % (n) 








...Do you use e-learning offerings on the LMS Blackboard in general? 


0(0) 


58.9 (10) 


412 (7) 








... Do you have a job in addition to studying? 


0 (0) 


70.6 (12) 


29.4 (5) 









information and anatomy basics without pathologies. As 
reasons for not having used NESTOR, non-users men- 
tioned a lacl< of time, not having been informed, not using 
e-learning in general (preferring books), or having little 
interest in the subjects of traumatology and orthopedics. 
When these students were asked what would make it 
more likely for them to use the e-learning offer, they espe- 
cially mentioned more announcements to be helpful for 
the future. 

Both users and non-users showed in general a strong ac- 
ceptance of a blended learning concept. Asked, which as- 
pects of orthopedics and traumatology could better be 
represented by e-learning versus face-to-face lessons, all 
answering students (11 users, 3 non-users) agreed on e- 
learning to be more useful for theoretical contents and as 
preparation for specific skills, for example, when exploring 
radiology-cases, or introducing physical exam or surgical 
procedures with videos. Face-to-face lessons were seen as 
particularly helpful for practicing examination skills or 
having discussions about clinical and radiological cases. A 
typical statement of one student was "I like the combin- 
ation of both. First you would use e-learning for getting to 
know the contents and for self-training. Then you would 
practically train the gained knowledge in the lessons with 
a teacher". 

Written tests and OSCE results 

Cronbach's Alpha for the written tests were 0.62 (pre-test), 
0.64 (post-test 1), and 0.63 (post-test 2). Results of the 
pre-test and both post-tests for the groups of users and 
non-users of NESTOR are shown in Figure 3a. Pre-tests 
revealed no differences between the groups. Users as well 
as non-users had significantly better results in both post- 
tests (p < 0.001), with slightly better results for NESTOR 
users in both post-tests. Students who used NESTOR 



further improved their results significandy between post- 
test 1 and 2 (p = 0.009), whereas non-users did not. The 
results of the OSCE revealed no differences between the 
groups (Figure 3b). 

Discussion 

The purpose of this pilot study was to give first impres- 
sions of the effect of a blended learning concept in or- 
thopedics and traumatology called NESTOR both on 
students' satisfaction and on its contribution to acquisi- 
tion of knowledge and clinical skills in a problem-based 
learning curriculum, which already provides an intensely 
practice-oriented teaching environment. To the best of 
the author's knowledge, this is the first study examining 
the influence of blended learning not only on satisfac- 
tion, but also on knowledge and practical clinical skills 
of students in traumatology and orthopedics, two highly 
practically oriented medical subjects. 

Evaluations of students' opinion and acceptance can 
be seen as first step when establishing a new e-learning 
program [4,14,21]. Consistent with the literature, this 
study revealed a high approval of the participating users 
for the additionally offered e-learning contents. While a 
broad acceptance is crucial for successful e-learning im- 
plementation [1], it is also important to evaluate its in- 
fluence on students' gain of knowledge and skills [9] . 

Thus, as second step, not only the impact on users' 
satisfaction, but also on their knowledge should be dem- 
onstrated [6,21,22]. For this pilot study we have chosen 
newly developed written tests to evaluate improvement 
in theoretical knowledge, which seem to be valid as indi- 
cated by the measured Cronbach's Alpha values. While 
some studies showed benefits of e-learning on improve- 
ment of students' knowledge [6,23] others did not - des- 
pite of positive evaluation [2,8,22]. In this pilot study, we 
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□ NESTOR User 
■ NESTOR Non-User 



100n 




Figure 3 Results of written tests and OSCE. Legend: (a) The 
results of the written pre-test, post-test 1 and post-test 2 for users and 
non-users of NESTOR showed significant improvement in post-test 1 
and 2 for both groups, compared to the pre-test (p < 0.001). NESTOR 
users further improved significantly from post-test 1 to 2 (p = 0.009), 
whereas non-users did not (b) The Results of the objective structured 
clinical examination (OSCE) showed no differences comparing users 
and non-users of NESTOR. Whisker = standard deviation. 



found a significant improvement from pre- to post-tests 
for both groups. NESTOR users scored better in the 
written post-tests than non-users and showed further 
improvement between post-test 1 and 2. A possible in- 
terpretation for this success in the group of NESTOR 
users may be students' very positive attitude towards e- 
learning and a high satisfaction with structure and con- 
tents. However, these results should be interpreted care- 
fully, especially when referring this effect exclusively to 
the use of NESTOR. In a recent review, Rowe et al. [12] 
showed that the existing data to evaluate an improve- 
ment of clinical competencies by blended learning can 
still be regarded as rudimentary. It seemed to be a prob- 
lem of the study design in a clinical environment to deter- 
mine the effect of blended learning exclusively. Rowe et al. 
identified 71 studies dealing with the role of blended 



learning in the clinical education of healthcare students, 
but only 7 articles were enrolled for the review due to 
methodological flaws of the remaining 64. 

As potential third step it might be anticipated that even 
practical clinical skills may be improved through blended 
learning in this context [9], which has been shown in some 
studies [9,16,24]. The results of the OSCE revealed no dif- 
ferences between users and non-users in this pilot study 
with high scores in both groups. These findings are con- 
sistent with other studies which failed to detect significant 
benefits on examination performance or other practical 
clinical skills with e-learning implementation [21,25,26]. A 
possible explanation could be that the pre-existing, highly 
clinically oriented curriculum made it difficult for any 
additional e-learning exposure to further improve skills. 

In this context, the question may arise what e-learning 
potentially can achieve [1]. It can be argued that clinical 
examination skills will always be preferentially based on 
personal experiences and training rather than on the use 
of e-learning - unlike acquiring skills in other areas such 
as radiological diagnosis [16]. In the presented pilot study, 
e-learning enhanced competencies for gaining theoretical 
medical knowledge. Further research will be necessary to 
determine, if it is possible to adjust the components of a 
blended learning approach in this context to achieve also 
an improvement of practical skills compared to mere face- 
to-face teaching. However, as knowledge about diseases is 
an important basis for developing treatment and examin- 
ation skills, this and the overall high approval provide 
good arguments for the continued use of NESTOR in the 
preparation for the tested subjects. Following suggestions 
of the non-users, acceptance of the program might be fur- 
ther increased by improving announcements about it. 
Additionally, it could be made even more appealing with 
links to e-learning programs of other subjects (e.g. anat- 
omy) of the faculty. 

Concerning the willingness to use e-learning offerings 
voluntarily, an additional inference can be taken from this 
study en passent: As the use of NESTOR was significandy 
linked to the use of LMS Blackboard, the likelihood of vol- 
untarily using an e-learning offering may be direcdy con- 
nected to the acceptance and use of the hosting LMS. This 
would require the need for the entire faculty to join in a 
combined effort to establish e-learning offerings broadly to 
increase students' familiarity with such resources. Thereby, 
voluntary and perhaps even mandatory use of e-learning 
components could be increased. 

There are some limitations to be noted in this study. A 
selection bias cannot be excluded due to the voluntary na- 
ture of participation and use of NESTOR, also with respect 
to the significant correlation between this aspect and a 
pre-existing use of the LMS Blackboard. This can be seen 
as main shortcoming, which was tolerated because data 
evaluation was incorporated into an ongoing mandatory 
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course to establish this new blended learning concept. This 
pilot study design guaranteed a high practical orientation 
and a sufficient number of participants. However, for final 
conclusions on the chosen blended learning technique a 
randomized controlled trial should rather be performed in 
the future. Furthermore, preexisting experiences in stu- 
dents' physical examination skills will have to be evaluated 
in the final implementation study by a pre-test. The possi- 
bility that the exposure to or interaction with any add- 
itional resources or experiences led to an increase in 
knowledge (i.e. due to a possibly more in-depth coverage 
of the topic), cannot be excluded completely with the 
study design. In a future study, there should also be a 
tracking function to detect the individual accessed e- 
learning tools or the time students spend with them. Such 
a study design would also avoid the present division of 
users and non-users merely according to their own declar- 
ation, as this step does not guarantee a correct assignment 
of data to the test and control group, respectively. 

Finally, no direct correlation between test results and 
questionnaires was possible due to guaranteed complete 
anonymity. This could have potentially given more infor- 
mation about individual user's attitudes towards the pro- 
gram and their concomitant test results. 

Conclusions 

This pilot study could underline that it is possible to 
achieve an improvement in theoretical knowledge com- 
bined with high acceptance of students with a blended 
learning program. The results indicate that the blended 
learning concept might be superior compared to face-to- 
face teaching alone, even in the setting of a problem-based 
learning environment where a high level of self-reliant 
learning has already existed. Future research on the pre- 
sented concept should assess which blended learning sce- 
narios might support best students' acquisition of practical 
examination skills and identify further crucial points in 
knowledge and competence transfer to support the im- 
provement of teaching in this context. Therefore well de- 
signed randomized controlled trials within realistic clinical 
education scenarios are still needed. 

Competing interests 

The authors declare that they have no competing interests. 
Authors' contributions 

DB and GS designed the study. NH, DB, AA and KS collected the data. DB, 
NH and EH analyzed and interpreted the results. DB drafted the article with 
substantial support by AA and EH. NH, KS and GS revised the paper critically. 
All authors approved the submitted version to be published. 

Acl<nowledgements 

The authors thank Mrs. Simone Gantz of the Orthopedic University Hospital 
Heidelberg for kind advice in statistical evaluation and Arash Calafi of the 
University of California, San Diego School of Medicine for his assistance in 
editing of this manuscript 



Author details 

^Department of Traumatology and Orthopedics, German Armed Forces 
Hospital Berlin, Scharnhorststrasse 13, 101 15 Berlin, Germany. ^Dieter 
Scheffner Center for Medical Teaching and Educational Research, Campus 
Virchow Klinikum, Charite - Universitatsmedizin Berlin, Augustenburger Platz 
1, 13353 Berlin, Germany. ^Center for Musculoskeletal Surgery, Department of 
Orthopedics, Charite - Universitatsmedizin Berlin, Berlin, Germany. "^Reformed 
Medical Track Program, Charite - Universitatsmedizin Berlin, Berlin, Germany. 
^Dieter Scheffner Center for Medical Teaching and Educational Research, 
Charite - Universitatsmedizin Berlin, Berlin, Germany. ^Department for 
Orthopedics, Traumatology and Paraplegiology, University of Heidelberg, 
Heidelberg, Germany. 'Julius Wolff Institute and Berlin-Brandenburg Center 
for Regenerative Therapies, Charite - Universitatsmedizin Berlin, Berlin, 
Germany. 

Received: 16 December 2012 Accepted: 4 December 2013 
Published: 27 January 2014 

References 

1. Ruiz JG, Mintzer MJ, Leipzig RM: The impact of E-learning in medical edu- 
cation. Acad Med 2006, 81 (3):207-21 2. 

2. Gray K, Tobin J: Introducing an online community into a clinical 
education setting: a pilot study of student and staff engagement and 
outcomes using blended learning. BMC Med Educ 2010, 10:6. 

3. Hull P, Chaudry A, Prasthofer A, Pattison G: Optimal sequencing of bedside 
teaching and computer-based learning: a randomised trial. Med Educ 

2009, 43(2):108-11Z 

4. Weltering V, Merrier A, Spitzer K, Spreckelsen C: Blended learning positively 
affects students' satisfaction and the role of the tutor in the problem-based 
learning process: results of a mixed-method evaluation. Adv Health Sci Educ 
Theory Pract 20C9, 14(5):725-738. 

5. Devitt P, Palmer E: Computer-aided learning: an overvalued educational 
resource? Med Educ 1999, 33(2):136-139. 

6. Romanov K, Nevgi A: Do medical students w/atch video clips in eLearning 
and do these facilitate learning? Med Teach 2007, 29(5):484-488. 

7. Shantikumar S: From lecture theatre to portable media: students' 
perceptions of an enhanced podcast for revision. Med Teach 2009, 
31(6)535-538. 

8. Heye T, Kurz P, Eiers IVl, Kauffmann GW, Schipp A: A radiological case 
collection with interactive character as a new element in the education 
of medical students. Rofo 2008, 180{4):337-344. 

9. Gormley GJ, Collins K, Boohan M, Bickle IC, Stevenson M: Is there a place 
for e-learning in clinical skills? A survey of undergraduate medical 
students' experiences and attitudes. Med Teach 2009, 31(l):e5-e12. 

10. Rajendran PR: MSJAMA. The Internet: ushering in a new era in of 
medicine. JAMA 2001, 285{6):804 

11. Garrison DR, Kanuka H: Blended learning: uncovering its transformative 
potential in higher education. Internet High Educ 2004, 7(2):95-105. 

12. Rowe M, Frantz J, Bozaiek V: The role of blended learning in the clinical 
education of healthcare students: a systematic review. Med Teach 2012, 
34(4):e216-e221. 

13. Citak M, Calafi A, Kendoff D, Kupka J, Haasper C, Behrends M, Krettek C, 
Matthies HK, Hufner T: An internet based learning tool in orthopaedic 
surgery: preliminary experiences and results. Technol Health Care 2009, 
17(2):141-148. 

14 Gesundheit N, Brutlag P, Youngblood P, Gunning WT, Zary N, Fors U: The 
use of virtual patients to assess the clinical skills and reasoning of 
medical students: initial insights on student acceptance. Med Teach 2009, 
31(8):739-742. 

15. DiessI S, Verburg FA, Hoernlein A, Schumann M, Luster M, Reiners C: 
Evaluation of an internet-based e-learning module to introduce nuclear 
medicine to medical students: a feasibility study. NucI Med Comniun 

2010, 31:1063-1067 

16. Ackermann 0, Siemann H, Schwarting T, Ruchholtz S: Effective skill training 
by means of E-learning in orthopaedic surgery. Z Orthop Unfall 2010, 
148(3):348-352. 

17. Ziegler R, Knopp W, Hohenberg G, Wendorf A, Redies M, Pohlemann T: 
MEC.O - Medical education online: a key to the knowledge extension in 
the student training in traumatology in the context of the "Neue 
Approbationsordnung fiir Arzte". GMS Med Inform Blom Epidemiol 2009, 
5(1):Doc04 



Back ef al. BMC Medical Education 2014, 14:17 
http://www.biomedcentral.com/1472-6920/14/17 



Page 8 of 8 



18. Wunschel M, Wulker N, Kluba T: A virtual orthopaedic hospital: feedback 
on student acceptance. Med Educ 2009, 43(1 1):1 113. 

19. Dreinhofer KE: The bone and joint decade-chances for orthopedics and 
traumatic surgery. Z Orthop Unfall 2007, 145(4):399-402. 

20. Clawson DK, Jackson DW, Ostergaard DJ: It's past time to reform the 
musculoskeletal curriculum. Acad Med 2001, 76(7):709-710. 

21. Perkins GD, Fulleiton JN, Davis-Gomez N, Davies RP, Baldock C, Stevens H, 
Bullock 1, Lockey AS: The effect of pre-course e-learning prior to advanced 
life support training: a randomised controlled trial. Resuscitation 2010, 
81{7):877-881. 

22. Armstrong P, Elliott T, Ronald J, Paterson B: Comparison of traditional and 
interactive teaching methods in a UK emergency department Eur J 
Emerg Med 2009, 16(6):327-329. 

23. Wunschel M, Leichtle U, Wulker N, Kluba T: Using a web-based orthopaedic 
clinic in the curricular teaching of a German university hospital: analysis of 
learning effect, student usage and reception. IntJ Med inform 2010, 
79(10):715-721. 

24. Lew/in 10, Singh M, Bateman BL, Glover PB: Improving education in 
primary care: development of an online curriculum using the blended 
learning model. BMC Med Educ 2009, 9:33. 

25. Hartmann AC, Cruz PD Jr: Interactive mechanisms for teaching 
dermatology to medical students. Arch Dermatol 1998, 134(6):725-728. 

26. Ridgway PF, Sheikh A, Sweeney KJ, Evoy D, McDermott E Felle P, Hill AD, 
O'Higgins NJ: Surgical e4earning: validation of multimedia web-based 
lectures. Med Educ 2007, 41 (2):1 68-1 72. 

doi:1 0.1 1 86/1 472-6920-1 4-1 7 

Cite this article as: Back et al.: Blended learning approach improves 
teaching in a problem-based learning environment in orthopedics - a 
pilot study. BMC Medical Education 2014 14:17. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at S —s-iui-j roni-rDl 

www.biomedcentral.com/submit \^ Biomea eencrai 



